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Abstract 

There has been an increase in reliance on pre-recorded lectures (PRL) as a source of learning in place of live-lectures 
(LL) in higher education today but whether PRL can effectively replace LL remains unknown. We tested how students 
performed in the exam questions when PRL replaced LL. While PRL+ group included those students who watched the 
video lectures, PRL- group was composed of students who either did not utilize these videos or accessed only briefly. 
Additional analysis involved the separation of exam questions, from both LL and PRL, into memory questions (MQ; 
basic factual details) and comprehension questions (CQ; requiring processing of the given information) and their 
comparisons. We did not find any significant difference in student performance between the LL and PRL groups as 
well as between LLMQ and PRL+MQ groups. However, students in the LL group performed significantly better on 
CQ compared to the PRL+ group (P<0.05). Furthermore, analysis of student performance between MQ and CQ among 
the PRL+ and PRL- groups revealed that both groups performed significantly higher on MQ compared to CQ (p<0.01 
between PRL+MQ and PRL+CQ and p<0.05 between PRL-MQ and PRL-CQ). These results suggest that LL helps 
students perform better on CQ, where it requires processing of given information compared to that of PRL. The 
effectiveness of PRL, at least from this study, is limited to mastering basic factual details but not suitable for complex 
conceptual processing and therefore may not fully be able to replace LL. 
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1. Introduction 

For several decades, instructors and students in higher education have attempted to record lectures for clarification, 
easy access, and distant educational purposes. What first started out as audio recordings on cassettes and VHS videos 
has steadily progressed into digital lecture recordings with advances in technology. Student dependence on these 
mobile lectures has increased exponentially in recent years (Beldarrain, 2006, Brown, & Green 2007, Cardall, Krupat, 
& Ulrich 2008, Colak, 2014, Copley, & Audio, 2007, Dey, Burn, & Gerdes, 2009, Marchand, Pearson, & Albon, 2014, 
Tune, Sturek, & Basile, 2013). As a result, most institutions have their major lecture halls equipped with tools for 
real-time lecture recordings (Chandra, 2011, Drouin, 2014). Online availability of recorded lectures provides 
flexibility for those students who are juggling the competing demands of work, studies, and other commitments. 
Students do utilize the lecture recordings to review course content, revise class notes, clarify complex concepts, and 
work at their own pace (Danielson, Preast, Bender, & Hassall, 2014). The ability to pause or replay the recordings 
benefits students especially those who do not speak English as their primary or native language (Maynor, Barrickman, 
Stamatakis, & Elliott, 2014, Ronchetti, 2010). 

In recent years, one common form of course content delivery is pre-recorded lecture (PRL) where the instructor records 
a lecture outside of class and share with students in a digital format, such as MP4, that can be accessed remotely from 
anywhere (Shah, Cox, & Zdanowicz, 2013). PRL has been used in lieu of live-lecture (LL) to allow more time in the 
classroom for active learning exercises (Armbruster, Patel, Johnson, & Weiss, 2009, Cavanagn, 2011). The use of PRL 
is increasing for many other reasons such as the flipped classroom mode of teaching (Ronchetti, 2010). The traditional 
didactic lecture method is heavily criticized as a passive approach. The video lecturing techniques are made simpler 
and are affordable which allows faculty to use the same recorded lectures so that their research agenda could be 
strengthened. PRL is not to be confused with lecture capture (LC), which is the real-time recording of an LL that 
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students can utilize to revisit lecture for various purposes (Hadgu, Huynh, & Gopalan, 2016, Maynor, Barrickman, 
Stamatakis, & Elliott, 2013). 

Educators have voiced concerns and opinions on potential negative as well as positive consequences of replacing LL 
with PRL. One controversial outcome could be absenteeism with the availability of recorded lectures (Figlio, Rush, & 
Yin, 2010, Maynor, Barrickman, Stamatakis, & Elliott, 2013). Even if the students attended a typical lecture, it is 
possible that they could be distracted by their mobile devices and social media during class especially when the 
recorded lectures are available for them to access at a later time (Colak, 2014). 

More and more institutions are beginning to phase out LL in favor of PRL for efficient information dissemination such 
as using class time for active learning (Cardall, Krupat, & Ulrich, 2008, Horvath et al., 2013). However, recorded 
lectures may not be utilized by every student (Kamad, 2015, Williams, Birch, & Hancock, 2012). Whether PRL can 
replace LL is an important question in this transition from live to recorded lectures. This notion became the interest and 
foundation for our study in which we replaced LL with PRL and compared student performance in the exam questions 
from those lectures. We later separated the questions based on Bloom’s Taxonomy (Bloom, Engelhart, Furst, Hill, & 
Krathwohl, 1956) from the two delivery methods, LL and PRL, to memory questions (MQ) which consisted of the 
basic factual details and the higher order comprehension questions (CQ) where the students were expected to process 
the given information to answer a question. We also studied the performance difference at both MQ and CQ levels 
between those who used PRL and those who did not. 

2. Methods 

Sixty Introductory Physiology students at St. Louis College of Pharmacy, 38 females and 22 males, ages 18 to 21, 
provided their informed consents to participate in this study. Approximately 60% of the students were female whereas 
40% were male, which was consistent with the class ratio. These students were enrolled in the Introductory Physiology 
course for the first time after having successfully completed pre-professional sophomore level Anatomy course. This 
course was held during a regular semester of 16 weeks where the class met for 50 minutes, three days a week, and was 
taught by the same instructor. Students were provided with the course objective as well as a brief description of each 
topic, which would be further elaborated during lecture. The lectures were given using images from the PowerPoint 
slides as well as quick drawings using the document camera in order to explain individual topics. Students were given 
study guides to foster engagement outside the classroom. There were group activities scheduled typically once before 
each unit exam in order to review the topics in the form of application questions. 

All class content, such as the syllabus, lecture objectives and study guides, was posted on the course management 
system, Moodle. Students were expected to have completed the reading assignments before class and were quizzed in 
every class period on the reading assignment as well as the previous day’s lecture content. Teaching assistants recorded 
student attendance and the class had perfect attendance primarily due to the daily quiz incentive. Additionally, all 
students were blocked from internet access to decrease distractions related to social media and/or online video games. 
Cell phone restriction was enforced during class time. All lectures were given live with the exception of two lectures 
that were pre-recorded to replace LL. The two PRL that we utilized in this study were not intentionally chosen, but 
instead were given due to unforeseen circumstances that led to class cancellation. PRL were approximately 40 minutes 
long and included PowerPoint slides and hand-written explanations where needed, which was consistent with LL. 

The course had six exams, five of which were unit exams and one was the comprehensive final. They were scheduled 
approximately three to four weeks apart with the exception of the fifth and the comprehensive exam, which were both 
given on the same day. Each exam was worth 10% of their final grade. Students who had an average of 85% on the first 
four exams were exempt from the final exam, but they still had to take the fifth exam. Questions from neither the fifth 
exam, nor the comprehensive final were included in this study given that finals week was not their normal week in a 
semester. Each exam consisted of 50 multiple choice questions from the new topics that were covered since the 
previous exam. The exam was typically written to test students’ abilities to answer factual details (50%), 
comprehension (35%) and application (15%) skills. 

2.1 Consent Forms 

Upon approval of the project by the Institutional Review Board, the written consent forms were distributed to the class 
size of 91 students out of which 60 students participated in this study (66%). Signed consent forms were obtained as 
students enrolled in the Advanced Physiology course which was immediately after the completion of the Introductory 
Physiology course. Students handed their consent forms directly to the Divisional Secretary who stored them until the 
final grade was submitted for the Advanced Physiology course. The student names and identification numbers were 
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removed and replaced with numeric codes prior to their performance analysis. 

2.2 Study Design 

The instructor-recorded lectures using Camtasia were re-recorded using Panopto , a software program with the ability 
to track the duration and frequency of student access. PRL was posted on Moodle , which was linked to Panopto. The 
recorded videos were in a streaming format and were unavailable for download to enable accurate viewing analytics. 
All of the students in this class were familiar with the process of accessing PRL as they were either concurrently and/or 
previously enrolled in other courses that expected students to use PRL as a replacement for LL. 

Two lectures, blood coagulation and the role of the liver, gallbladder and the pancreas in digestion , were never given 
live in class but only shared in the form of recorded lectures. Students who watched at least half of the PRL comprised 
our PRL+ group, while students who either did not access the PRL or watched only short snippets (2 to 4 minutes) 
constituted the PRL- group. The questions from these two lectures were compared with that of two randomly selected 
lectures, the regulation of glomerular filtration and the transportation of oxygen and carbon dioxide in the blood, 
which served as our controls. Students that attended these two live lectures served as our LL group. 

To evaluate student performance, we separated questions that came from both LL and PRL. In our study, 21 questions 
were derived from LL and 20 questions from PRL. We then classified the questions from each group into two 
subgroups: memory questions (MQ) and comprehension question (CQ). MQ referred to the recall of factual details and 
CQ required demonstration of deeper understanding of concepts. Although Bloom’s taxonomy (Bloom, Engelhart, 
Furst, Hill, & Krathwohl, 1956) includes additional hierarchy of question levels such as analysis and application, we 
lacked sufficient question samples to develop a valid statistical analysis for higher order questions beyond 
comprehension level. We were also interested to learn how the students who did not use PRL (PRL-) compared with 
that of those who did (PRL+) in both MQ and CQ (Figure 1). 


LL vs. PRL 



Figure 1. Summary of the Study Design 

2.3 Statistical Analysis 

One-way analysis of variance with appropriate post-test was applied using Graphpad InStat. 

3. Results 

Data analysis from the two PRL and two randomly selected LL were organized as shown in Figure 1 and the results are 
summarized as below. 

3.1 LL vs. PRL+ 

Students in the LL group answered 77.7% of the questions correctly compared to 76.2% on PRL questions. These 
results were not statistically significant (Figure 2). 
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Lecture Styles and Student Performance 



Lecture Style 


LL 

PRL (+) 
PRL H 


Figure 2. Student Performance in Live Lecture versus Pre-recorded Lecture 


3.2 MQ vs. CQ 

Students from the LL group had 78% of the answers correct on CQ whereas the students from the PRL+ group had 51% 
of the answers correct which was statistically significant (p < 0.05; Figures 3 and 5). Additionally, the percentage 
correct for the PRL+MQ was 81%. Comparison of PRL+CQ and PRL+MQ showed a statistically significant 
difference (p < 0.01). These results suggest that students performed poorly on CQ from the PRL+ group compared to 
the CQ from the LL group as well as the MQ from the PRL+ group. 
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Figure 3. Comparison of Student Performance on Memory and Comprehension Questions (* p<0.05 PRL+CQ 
compared to LLCQ; ** p<0.01 PRL+CQ compared to PRL+MQ) 


3.3 PRL+vs.PRL- 

The percentage of students accessing 50% or move of PRL was 36%. We compared the performance of these students 
on exam questions who used PRL (PRL+) with those who did not (PRL-). PRL+ group had 76.2% of the answers 
correct whereas the PRL- group had 72.8% of the answers correct (Figure 2). These values were not significantly 
different suggesting that student performance was not affected by viewing of PRL or not. 

3.4 MQ vs. CQ 

Although the overall comparison of PRL+ and PRL- groups suggested that there was no difference between these two 
groups, we further analyzed student performance on CQ and MQ of the PRL+ and PRL- groups and found that the 
PRL+ group obtained 81% of correct answers in MQ compared to PRL- group who had 72% of the questions correct. 
These numbers were not significantly different but certainly showed a downward trend for the PRL- group. On the 
other hand, when the performance on CQ by PRL+ group was compared with that of PRL+MQ, they had scored 
significantly lower on comprehension questions (PRL+CQ: 51%; p<0.01; Figures 3 and 6). Similarly, when the 
performance on CQ from the PRL- (PRL-CQ) group was compared with the performance on PRL- MQ, it was 
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significantly lower (PRL-CQ: 56%; p<0.05). These results indicate that PRL+ and PRL- students perform feebly on 
CQ compared to MQ. 


Comparison of PRL+ and PRL- 
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Figure 4. Comparison of Memory and Comprehension Questions of PRL+ and PRL- (*p<0.05 when compared to 

PRL-MQ; **p<0.01 when compared to PRL+MQ) 

3.5 Summary of Study Results 
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Figure 5. Summary of the Study Results 

4. Discussion 

As technology and time progresses, we can expect a shift in the statutes of student engagement and learning. There is a 
surge in demand for PRL either as a supplement or as a replacement for LL. The innumerable options for lecture video 
production, convenience of using these lectures repeatedly and its accessibility with the advancement of teaching 
technology has led to increased use of PRL today. Moreover, it appears that the students of the digital era may prefer to 
access PRL remotely than being in the classroom (O’Callaghan, Neumann, Jones, & Creed, 2015). All of these and 
more have stirred concerns on our traditional didactic methods of teaching. The current study attempted to answer this 
dogma. Our results suggest that the in-class teaching is invaluable in students handling conceptual learning as tested by 
their exam performance. Whether it is related to the classroom conditions we created, where students were limited 
from accessing internet or cell phone to avoid distractions, which we obviously could not be imposing outside for PRL, 
is difficult to argue. PRL is supposed to foster students with individual responsibility to learn on their own. Students 
can access PRL at any time and from anywhere. But, based on our findings, not all students assumed responsibility and 
utilized PRL as expected because only 36% of the students accessed PRL, and such behavior is observed by others as 
well (Vandsburger, & Duncan-Daston, 2011). 

Additional data exploration, where the questions were separated into MQ and CQ, students performed better on MQ in 
the PRL groups but not on CQ. Performance on CQ requires higher-order thinking and a greater understanding of the 
presented information than MQ (Bloom, Engelhart, Furst, Hill, & Krathwohl, 1956). The statistics of the student logs 
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indicated that majority of the students accessed these lectures only a day or two prior to their assigned exam. Similar 
observations are made by others (Groissen, Van Bruggen, & Jochems, 2012) suggesting that students using PRL had 
less time to process the information that was given in the video format in comparison to LL. Other variables such as 
lack of motivation, lack of organization to plan scheduled study times, lack of prioritization and outside distractions 
could not be ignored. Other similar studies where informal feedback was received from students who used PRL 
suggests that they were less effective than LL because of the lack of visual stimulation and kinesics (Lovell, & 
Plantegenest, 2006). With virtual lectures come the loss of a rich learning environment- an environment where 
instructor clarification and student-to-student engagement flourishes. This illustrates that the LL experience and 
interactive classroom community can prove more valuable than the actual information presented in class (Leadbeater, 
Shuttleworth, Couperthwaite, & Nightingale, 2013). 

PRL appears to help students perform higher in MQ than CQ. This could be due to the ability to revisit terminology or 
new concepts presented in the lecture videos at their own pace (Prunuske, Batzli, Howell, & Miller, 2012) or due to the 
fact that students accessed these videos shortly before the exam. The ability to pause and replay the videos may aid in 
memorization of new information whereas in LL, students rely on their ability to take adequate notes. In fact, a student 
survey conducted by another study showed that students in LL reported that they spent more time on taking notes at the 
lecturer’s pace rather than at their own (Leadbeater, Shuttleworth, Couperthwaite, & Nightingale, 2013). Furthermore, 
viewing PRLs can increase MQ accuracy by providing auditory and visual cues on emphasized points that students 
may have missed if they were to learn the material live. 

Our study, along with others, elucidates that PRL implementation can provide additional, supplementary options of 
study methods for students (Cardall, Krupat, & Ulrich, 2008, Schreiber, Fukuta, Gordon, 2010). Although PRL may 
improve learning of factual details, its use in replacing LL may hinder students from conceptualizing complex 
information sometimes due to technical challenge (Rose, 2009). Furthermore, social skills and professionalism are 
known integral parts of the classroom experience. Reliance on only PRL may deprive students of these crucial social 
aspects of their learning and development into professional individuals (Karnad, 2015, Prodanov, 2012). 

One limitation of this study was the small sample size of 60 students. The PRL sample size became even smaller with 
only 36% of student access. Another variable that could improve the study would be randomly assigning students to 
either PRL or LL group. Because our study was based on students’ own accord, the same student could fall in both LL 
and PRL groups. 

5. Conclusions 

It is evident from our study that learning is more comprehensive when students are in a classroom setting rather than 
learning from a recorded video although the same instructor provides lecture recordings. This study suggests that 
automatizing learning has its limitations. 
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